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ABSTRACT 

This final evaluation report of the 1970-71 New Haven 
Bilingual Education Program’s effectiveness in the various areas of 
instruction is a presentatj.on of analyses of data gathered on student 
performance in oral language proficiency (English only) , reading 
comprehension (English only) , mathematics, and student self concept 
(administered in the dominant language only) — the students having 
been pre- and post- tested in these areas. The document presents only 
an assessment of the program’s effectiveness insofar as achievement 
of product objectives (behavioral changes in students and other 
participants) is concerned, the processes or procedures used to 
achieve various program products having been assessed in an earlier 
report, the Interim Evaluation Report, Among the findings were; (i) 
teachers felt that the learning of a second language for Anglos was 
enough of an advantage to the students to include them as 
participants of the ESEA Title VII program — and the evaluators felt 
that the program must enhance its efforts in this area; <ii) analyses 
cf sociometric data did not yield clearly discernable results — it 
being not possible to argue that the program had generally improved 
mixing between Puerto Rican and Anglo children; (iii) in word 
knowledge, reading, and mathematics, it was found that the program 
classes showed a positive and, in many cases, significant growth; 
and, (Iv) in general, there was no significant difference between the 
program and control children on T- tests done on scores for self 
concept. (Author/RJ) 
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preface 



The evaluation team of Dunlap and Associates extends thanks to all 
who cooperated in this effort and apologies for the extended delay in publica- 
tion of this document. Data analysis, especially regarding student self-concept 
and socio-interactions, were responsible for weeks of delay. The experimental 
procedures used to gather the data were not supported by any new developments 
in data analysis procedures. If we are unable to computerize these two affective 
measures before long, their use will be disccr«inued. 
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FINAL EVALUATION REPORT 1970-71 



. I. INTRODUCTION 

The evaluation team, under the direction of Mr. Bernard Cohen, has 
compiled sets of data which represent the 1970-71 New Haven Bilingual 
Education Program’s effectiveness in various areas of instruction. This 
report is a presentation of analyses of data gathered on student performance 
in these areas. Students were pre- and post-tested m the following instructional 
areas; 

oral language proficiency (English only) 
reading comprehtension (English only) 

. mathematics 

. student self-concept (administered in dominant language only) 

This document presents only an assessment of the Program's effectiveness 
insofar as achievement of product objectives is concerned. (Product is seen 
as the behavioral changes in students and other participants.) Program 
processes or the procedures used to achieve various program products, 
were assessed in the evaluation team's Interim Evaluation Report, February 
1971. This report is divided into numerous sections with each section being 
devoted to a particular program product. Due to certain time constraints as 
well as the fact that unexpected vacations delayed preparation of this report, 
we have been unable to translate this document into Spanish. However, in order 
to meet the standards set by the Interim Evaluation Report which was published 
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bilingually, the Spanish version of this report will be prepared as soon as 
possible . 

More than five members of the Dunlap team participated in gathering and 
analyzing data related to this program’s effectiveness. The effort was coor- 
dinated by Mr. Bernard Cohen, Director of Dunlap’s Evaluation and Audit 
Program. Mr. Robert McCay provided inputs to the design of the sociogram 
while Mr. Bernard Stowens coordinated the analysis of sociometric data. 

Mrs. Betsy King coordinated data analysis in academic areas while Mr. Michael 
Nacht designed the data analysis procedures. Mesdames Stacy Shaw and 
Arlene Cleven assisted with data collection. 

The evaluation team would like to thank JUNTA for its participation in 
data* gathering procedures and would also like to thank all of the participating 
teachers for their cooperation. As we have pointed out in the past, the develop- 
ing concepts involved in bilingual education result in developing concepts in 
related evaluation procedures. While Dunlap and Associates, Inc. , has been 
involved in evaluating education and/or training programs for more than 
twenty years, very few of the procedures used to assess the New Haven 
Bilingual Education Program were ever used in past efforts. As a result, 
many of the procedures will fail or result in seriously modified evaluation 
procedures in the future. Unfortunately, we are pioneering in the evaluation 
area just as the teachers are pioneering in the classroom. It is for this 
reason that our evaluation design was modified from year one to year two 
and will again be modified for the program’s third year. 
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As indicated in the analysis in baseline data section of the Interim Evaluation 
Report, a primary source for evaluating the impact of this program is the com- 
parison of test scores at the start and finish of the academic year. This *’post- 
versus pre-** test comparison includes six areas of analysis: 

1 . word knowledge 

2 . reading 

3. mathematics 

4. language 

5. self-concept 

6. sociometric factors 

A summary of the number of classes examined in these areas follows. 



Table I 



Summary of Classes Examined for New Haven Title VII 

Baseline and Post- Test Data 



Baseline (Pre-Test) Post- Test 



Subiect Area 


Code 


Bi-Ling. 

Classes 


Control 
Classes 
Prince Non- VII 


Bi-Ling. 

Classes 


Control 

Classes 

Prince Non- T 


Reading 












Readiness RR 




- 




6 


2 


Language 


RR 


2 


0 


2 


0 




1 


2 


0 


2 


0 




2 


2 


1 


1 


1 




3 


2 


1 


2 


1 


Self-Concept 


RR 


2 


0 


2 


0 




1 


2 


0 


2 


0 




2 


2 


1 


2 


1 




3 


2 


1 


2 


1 


Sociometric 


RR 


0 


0 


1 


0 


Factors 


2 


1 


1 


1 


1 




3 


2 


1 


2 


1 


Word 


2 


2 


1 4 


2 


1 4 


Knowledge 


3 


2 


3 4 


2 


3 4 


Reading 


2 


2 


1 4 


2 


1 4 




3 


2 


3 4 


2 


3 4 


Mathematics 


2 


2 


1 4 


2 


1 4 




3 


2 


3 4 


2 


3 4 
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II. UPDATED PROCESS EVALUATION 



Before presenting this year’s product data, the evaluation team would like 
to present several additions to the Interim Evaluation Report which dealt pri- 
marily vith program processes. 

Program Management 

The evaluation team presented an extensive assessment of program 
management in the Interim Report. At this time we would only wish to discuss 
one section - Dissemination. The Interim Report identified program dissemina- 
tion as one of management’s weak areas. In order to provide the Project Director 
with further assessment and needs analysis in this area, the evaluation team 
gathered data from a survey sent to all teachers who were not involved in Title 
VII but who were teaching in the participating schools. Approximately thirty 
teachers responded to an anonymous survey which asked questions in seven 
areas: 

had they heard of the program? 

do they understand the special teaching concepts used in Title VII? 

. do they think that Puerto Rican children should be taught English 
as soon as possible? 

. do they think Spanish dominant Puerto Rican children should be 
taught subject areas in Spanish? 

do they think that children should be segregated for intensive 
language training? 
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should the Puerto Rican children in their classes have a bilingual 



education setting? 

. would the non- Puerto Rican children have been provided a greater 
service if they were given a bilingual education setting during the 
past year? 

Each of these areas reflects a certain philosophy related to bilingual educa- 
tion. It is important to remember that this survey was distributed to the teachers 
who are not involved directly in bilingual education. This, therefore, is an assess- 
ment of the program’s ability to present public information to fellow teachers. 

100% of all teachers contacted had heard of the program. This is in direct 
contrast to last year’s results which showed only 30% having heard of the pro- 
gram at the end of year one. 

Only 52% of the teachers felt that they understood the concepts involved in 
instructing within a bilingual education setting. The evaluators suggest that 
two processes be implemented during the early weeks of the next school year. 

First of all, we suggest that the project administration circulate the Grade 
School Magazine article about bilingual education to all teachers in the New 
Haven Public School system. This article about bilingual education used the 
New Haven program as its referral source and continuously cites specific 
teaching methods used within the bilingual education setting. We would also 
suggest that the teachere involve themselves in a workshop open to all other 
teachers in the participating schools. This brief workshop could be conducted 




-le 



during a lunch hour session and could be used to provide the non- participating 
teachers ^^^th an introduction to bilingual education. 

100% of all surveyed teachers felt that Puerto Rican children should learn 
English as soon as possible. The evaluators expected no other result. On the 
other hand, only 46. 4% of the responding teachers felt that Puerto Rican children 
should be instructed in Spanish insofar as the major subject areas are concerned. 
The instruction of Spanish dominant children in the dominant language is an im- 
portant aspect of bilingual education. Therefore, it is necessary for next 
year's program administration to disseminate information about the advantages 
to bilingual education, especially in instructing students in their dominant 
language. Segregating students is one topic which causes teacher reactions to 
run high. In this instance 43. 5% of all questioned teachers felt that students 
should be segregated for intensive language training. However, exactly the 
same percentage responded negatively with a few being unable to respond. 

Bilingual education does not segregate students on a classroom basis. Dividing 
children into language dominant groups within a classroom is permitted for 
certain types of instruction. This must be made clear to all of the non- participating 
teachers. 

Finally, all teachers were asked whether or not they felt that their students 
during the school year 1970-1971 would have been provided a greater service 
had they been involved in a bilingual education setting. 35% of the surveyed 
teachers felt that the Puerto Rican children would have benefitted from such a 
classroom setting. However. 46% responded negatively with 17% abstaining. 
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Exactly Lhe same percentage of teachers responded positively to a similar 
question pertaining to their non- Puerto Rican children. In other words, 35% 
of the teachers felt that their Anglo children would have been provided a 
greater service were they included in a bilingual education program. In this 
case, however, only 40% responded negatively. Several teachers felt that 
the learning of a second language for Anglos was enough of an advantage to the 
students to include them as participants of the Title VII Program. 

As evaluators of the dissemination processes, we feel that the program 
must enhance its efforts in this area. Several of the Ti„le VII teachers have 
been in the participating schools for many years. Using these teachers as 
"legitimizers” would serve to not only teach the non- participating teachers 
about bilingual education, but would improve the program’s in-house image. 

Although the products of dissemination have improved since the program’s 
first year, the project management will need to pay still more attention to 
this area. As evaluators we have been in a position to observe the local 
school principals and their affect upon non- participating teacher attitude. 

The recent change in principals at the Truman School should result in an even 
greater improvement in next year’s dissemination product measurement. 

(All other aspects of program management were assessed in the last 
evaluation report and stand as so stated. ) 
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Community Participation 



Again, this process was evaluated in the Interim Evaluation Report. How- 
ever, we would like to take this opportunity to update that report by documenting 
the community's participation in the evaluation processes. Once again, a 
representative from JUNTA, the local Puerto Rican Community Action Organiza- 
tion, actually gathered post-test data as a member of the evaluation team. Mem- 
bers of the Dunlap team trained the community participant to administer the John 
T. Daily Test of Language Facilities and the Dunlap Self-Concept Survey. Data 
gathered by the JUNTA representative was compared to that gathered by the 
Dunlap team in order to ensure that objectivity was being maintained. 

During the next years* s data gathering procedures, the evaluation team is 
going to seek participation from a more representative group. They will continue 
to use a JUNTA representative but will also employ a few program parents in ar 
attempt to extend community participation into parent participation. 

Staff Development 

The summer of 1971 saw a comprehensive workshop for teachers planned 
and implemented by the project administration. A survey will be sent to 
teachers in order to assess the summer workshop and make plans for improving 
next summer’s workshop. The results of the survey will be presented in next 
year’s Interim Process Evaluation. 
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The evaluation team can report on a series of interviews conducted by 
Mr. Bernard Cohen during the final days of the teacher workshop. A general 
summary of comments would discuss three issues. First of all, most teachers 
were quite satisfied with the presentations made and workshops conducted by 
guest consultants. Although some of them were said to speak on an academic 
level above the comprehension of some workshop participants, teachers felt 
that "you took what you needed and let the professor -type talk go on by. " Other 
comments by the teacher-participants related to the fact that they were pleased 
to have time during the summer to prepare instructional materials for their 
classrooms. 

On the other hand, it was unfortunate that the bilingual education workshop 
had to be scheduled at the same time as a special workshop for the open school 
teachers. All of the teachers who taught at Horace Day School last year will 
be moving to the open school situation and were required to attend the open 
school workshop. The bilingual education workshop, therefore, served only 
those teachers who are working at the Truman School. 

In spite of not having all participating teachers attend this workshop, con- 
troversial issues were discussed with resolutions in many cases. For example, 
it was resolved that all Spanish dominant children will be taught subject area 
lessons in their dominant language. In the past, this was an accepted theory, 
but was not implemented in all classrooms. 




M. 



III. ANALYSIS OF SOCIOMETRIC DATA 



Analysis of sociometric data was carried out following transformation 
of the data into summary tables as shown in Appendix A. Each entry in 
these tables indicates the total number of cases in which a particular choice 
was made for a given class type across all situations of that type. For 
example, in the first table listed, the entry ’*45” indicates that in 45 
different cases Puerto Rican students chose other Puerto Rican students 
in response to four different positive situations in Grade Two bilingual 

courses during pre-testing. 

These data were examined with a view towards assessing the extent 
to which ethnic homogeneity is maintained during the bilingual program. 

In particular, a simple measure of statistical association known as 
Yule's Q was employed in this analysis. For each summary table 
listed in Appendix A Yule's Q was computed. These statistics are 
summarized in Table 1 . A general reaction to these statistics is their 
overall lack of strength. By this we mean that it has become common 






For a 2x2 table as below. Yule's Q is computed as shdwn: 





®i 


®2 


^1 


a 


b 


A^ 


c 


d 



^ ad-bc 
Yule’s Q =- a(tf B e - 



association between variables A^ and . A Q value of -1 indicates a 
perfect dissociation between variables Aj and Bj (and, in fact, a perfect 
association between Aj and B^. A Q value of O indicates that no association 
exists between the variables. 



among users of this method to think of relatively strong associations between 
variables if Q values of 0. 5 or greater or -0. 5 or less. Of the sixteen 

entries in Table 2, only five fit these criteria, indicating that the overall 
relationships measured are not one of uniformly strong associations. More 
specifically, a number of hypotheses were formulated and, using the Yule’s 
Q results, their validity may be interpreted as follows: 

Hypothesis 1 : Within a grade, the amount of inter- ethnic association 
will be materially greater at the end of a school year than at the beginning 
for those in the bilingual program. 

Result 1: Yule's Q results are mixed. Pre- versus post- comparisons 

for Grade 2 yield . 09 versus . 36 for positive situations, indicating a weak 
but increased intra~ ethnic association. Grade 3 statistics are .67 versus 
.64 yielding virtually no change. For negative situations. Grade 2 statistics 
are -. 37 versus .43 which is a move toward inter-ethnic association. 

Grade 3 results are the reverse tending from . 10 to -. 26, which is in the 
direction of increasing the intra-ethnic association. Therefore, comparisons 
of these statistics do not support the hypothesis that the overriding trend is 
toward increased inter- ethnic association. 



**Note that Yule's Q is a distribution-free statistic. As such there is no 
comparison made between the computed value and a "tabular value" to 
determine the extent of significance. Interpretation of the meaning of 
the computed value is therefore left to "rules of thumb" rather than based 
on rigorous statistical grounds. 

In general, a highly positive value for a "positive situation" condition in- 
dicates great intra- ethnic association, which was not considered as de- 
desirable as increasing inter-ethnic associations. A highly negative value 
for a "negative situation" condition indicates great inter- ethnic association. 
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Pre-test 



Post-test 




I Positive 
L « Situation 
I , 

V 

i; 

I;. 

Negative 
Situation 



Positive 

Situation 

Negative 
I Situation 



Grade 2 


Grade 3 


Grade 2 

i 


Grade 


.09 


.67 


.36 


.64 


-.37 


. 10 


.43 


-.26 


.04 


.67 


.70 


.02 


-. 16 


-. 19 


••• 06 


-. 52 



Yule’s Q Values for Sociometric Summary- 
Data Shown in tables of Appendix 
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Table 



Hypothesis 2 ; Inter-ethnic association will be substantially greater in 
bilingual than in control classes. 

Result 2: For positive situations , Grade 2 statistics tend to confirm this 

hypothesis, but Grade 3 statistics do not. For Grade 2, the pre- to post- 
change is frcm.09 to . 36 for bilingual students while control data indicate a 
shift from . 04 to . 70. Therefore, in this grade, there was a greater 
shift toward increasing inter- ethnic associations in the control classes than in 
the bilingual classes. For Grade 3, however, the bilingual classes remain 
relatively static (.67 versus .64) while the control classes find a sharply 
reduced degree of intra-ethnic association (.67 to . 02). Although the program 
third grade classes did better than the control classes, the results must be 
inconclusive. The results for negative situations are equally conflicting with 
no discernible "mixing effect" readily attributable to the bilingual classes 
vis-a-vis the control classes. 

Since the summary data results were both conflicting and inconclu.sive, 
a second phase of the sociometric analysis was performed whereby Yule's 
Q statistics were computed for each individual situation type. These statistics 
are summarized in Table 2. Pre- versus post- bilingual statistics indicate 
the following patterns: 

#1, “Play" situations , both positive and negative, showed a trend 
toward increased inter- ethnic association (true for Grade 2 but not Grade 3). 

..#2* Negative "Work" and "Sit" situations exhibited increased inter- 



Grade 2 



Bilingual Control 



I--' 


• 


Pre 


m • 

* 


Play 


Positive 


-556 


j{ 

ii 


Negative 


-.555 


J 

1 

j Work 


Positive 


. 157 


I 

i 


Negative 


- . 60 1 


f 

1 

1 

1 


Positive 


177 


Negative 


. 132 




• 


... 


i Lead 


Positive 


.384 






Post 


Pre 

4 


Post 


.376 


.333 


.900 


.463 . 


.214 


-. 368 


. 625 


.447 


.723 


.335 


-.1.0 


. 189 


.247 


.40 


. 380 


.515 


-. 355 

1 


-.009 


. 161 


4" 

. 200 


.741 



Yules Q for Individual Situation Sociometric Data 



Grade 3 

Experiment Control 





t 


Pre 


Post 


Pre 


Post 

1 

-.034 ^ 


Play 


Positive 


.707 


.756 


.729 


-.615 ■ 




Negative 


.009 


-.487 


.20 


Work 


Positive 


.638 


.742 


.730 


i 

-.037 ? 


•- 


Negative 


-.055 


-. 199 


-« 466 


-.607 ; 

1 


Sit 


Positive 


.653 


.547 


. 590 


■i 

-. 037 1 

1 


Negative 


.421 


-. 124 


-. 368 


-.458 ^ 

i 

>i 


Lead 


Positive 


.594 


.507 


.641 


-. 189 ; 



Table 3 
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ethnic associations but positive ’*Work“ and ’*Sit'* situations exhibited increased 
intra- ethnic associations. (True for Grade Z only). 

#3. Leadership situations exhibited moderate increases in intra-ethnic 

associations both for Grades 2 and 3. 

When comparing bilingual versus control classes » the following trends 

were present: 

1. The most marked difference between bilingual and control classes 
was for Grade 2 positive pla.y situations , where bilingual classes exhibited 

movement toward increased inter-ethnic association {. 556 to . 376) while 
control classes greatly increased intra-ethnic association (. 333 to .990). 

2. The leadership situation for Grade 2 shows a substantial inter-ethnic 
association increase for bilingual classes (.384 to .161) while control classes 
were strongly increasing in intra-ethnic associations (.200 to . 741). 

3. In numerous other individual situations, both positive and negative, 
bilingual classes were not strikingly more inter- ethnically associated than 
control classes, and in some cases (e.g. , Grade 3 work situations )they were 
far more intra- ethnically associated than control classes. 

In summary, then, analysis of the sociometric data did not yield clearly 
discernible results. It is not possible, based on these results, to argue that 
the bilingual program has generally improved ’’mixing’* between Puerto Rican 
and Anglo students. Such was the case in certain instances, but this was also 
found in selected control classes as well. Because of student and teacher 



differences, as well as the effect of the sociometric test itself, it is not 
possible to isolate the contribution which the bilingual program has made 
toward improving inter- ethnic associations among the Naw Haven elementary 
school students as a res\xlt of last year's testing. However, we repeat, 
that growth was definitely observed in certain classes under certain conditions 
as measured by the sociomeiric test. 
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Table 4 



1, Grade Two, Pre-test, Positive^^ 

BILINGUAL 

Chooser Chosen 



Chooser 



CONTROL 

Chosen 



Puerto 

Rican 


45 


42 


Puerto 
R Lean 


12 


1 

25 


Anglo 


43 


48 


Anglo 


34 


77 



2. Grade Two, Pre-test, Negative** 

BILINGUAL 
Chooser Chosen 



Chooser 



CONTROL 

Chosen 



Puerto 

Rican 


23 


43 


Puerto 

Rican 


7 


26 


Anglo 


38 


33 


Anglo 


22 


58 



3. Grade Three, Pre-test, Positive 

BILINGUAL 
Chosen 
P. R. Anglo 



Chooser 



Chooser 



CONTROL 

Chosen 

P. R. Anglo 



Puerto 

Rican 


70 


61 


Puerto 

Rican 


37 


22 


Anglo 


55 


240 


Anglo 


20 


60 
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4, Grade Three, Pre-test, Negative 

BILINGUAL 

Chooser Chosen 



Puerto 

Rican 

Anglo 



25 


72 


50 


178 



Chooser 

Puerto 
R lean 

Anglo 



CONTROL 

Chosen 



^ A A 

13 


31 


23 


37 



* A positive social situation is one in which a child chooses to associate with 
another child for a particular activity. 

**A negative social situation is one in which a child chooses not to associate 
with another child for a particular activity. 
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5, Grade Two, Post-test, Positive 
Chooser 



BILINGUAL 

Chosen 



Chooser 



CONTROL 

Chosen 





P.R, 


Anglo 




P.R. 


Anglo 


Puerto 

Rican 


77 


31 


Puerto 

Rican 


53 


28 


Anglo 


51 


44 


Anglo 


22 


65 


6. Grade 2, 


Post-test 


, Negative 








BILINGUAL 




CONTROL 


Chooser 


Cho' en 


Chooser 


Chos en 




P.R. 


Anglo 




P. R. 


Anglo 


Puerto 


54 


29 


Puerto 


26 


33 


Rican 






Rican 






Anglo 


31 


42 


Anglo 


31 


35 


7. Grade 3, 


Post-test, Positive 








BILINGUAL 




CONTROL 


Chooser 


Chosen 


Chooser 


Chosen 




P.R. 


Anglo 




P.R. 


Anglo 


Puerto 


88 


53 


Puerto 


21 


26 


Rican 






Rican 






Anglo 


59 


164 


Anglo 


35 


45 


8, Grade 3 , 


Post-test, Negative 








BILINGUAL 




CONTROL 


Chooser 


Chosen 


Chooser 


Chosen 




P.R. 


Anglo 




P.R. 


Anglo 


Puerto 


28 


79 


Puerto 


9 


27 


Rican 






Rican 






Anglo 


63 


104 


Anglo 


31 


29 
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IV. ANALYSIS OF DATA IN ACADEMIC AREAS 



In order to assess the effectiveness of the bilingual education program, 
the evaluation team used data in several academic areas and is now able to 
present an analysis of said data. 

Tables 3 and 4 present results from the Munroe Reading Aptitude Test 
as achieved by the children in the bilingual education program in a control 
school. 

The post-median percentile scores for experimental and control situa- 
tions are amazingly close. Differences lie only in two areas. The median 
percentile for Spanish surnamed children insofar as motor skills are con- 
cerned is 24%. In comparison, the control groups median score is 12%. 

On the other hand, the control groups median score for Spanish surnamed 
children insofar as articulation is concerned is 25%. The program’s group, 
on the other hand, is only 5%. This testing was performed by the school 
with no control by the evaluation team. The Truman Horace Day schools 
did not test 24 of their children in auditory articulation and language skills. 
Therefore, these data are interesting but not to be used for any decision 
making. 
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Analysis of Product Data 



Six subject areas were included in the data which were collected for 
product evaluation of the New Haven Title Vll Bilingual Program. These 
included: 1) language, Z) self concept, 3) socio-metric factors, 4) word 
knowledge, 5) reading, 6) mathematics. Four different grade levels were 
involved in product data testing (reading readiness, first, second, third). 
Within these grades, pre- and post-testing was conaucted for both bilingual 
classes and control classes. Control classes were divided into those within 
the Project Schools and those within a non-Title VII school. A summary of 
the number of classes examined in each of these areas is contained in Table 
I. In addition to the six subject areas cited above, the Table also indicates 
that reading readiness post-tests were conducted in six bilingual classes and 
two control classes, the control classes being within the Project Schools. 

More detailed information on the reading readiness program is con- 
tained in Tables II and III and in Figure I. . Table II presents a summation 
of lac te&it scores of the Monroe Reading Aptitude Test as achieved by the 
children in the bilingual education program. It indicates that 103 Anglo 
children and 45 Spanish children were involved in the testing. Table III 
presents a similar summary statistic for the control group, with 28 Anglos 
and 7 Spanish participating in the testing. Median percentiles for Anglo and 
Spanish children are presented at the bottom of each table. This allows one 
to readily compare performance between these two groups for visual, auditory, 
motor, articulation, and language subject areas. Figure I places these 

25 
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Percentile Score Percentile Score 



MEDIAN SCORE PROFILES OF MUNROE READING APTITUDE 





Table 5 



CONTROL SCHOOL 



Truman and Horace Day Schools Reading Readiness Program 



Frequency of scores May 1971 



Percentile 1 


Visual 


Auditory 


Motor 1 


Artie ul. 


Language 






A 


s 


A 


s 


A 


S : 


A 


s 


A r s 


95-99 


.% 


1 


1 


9 


1 


1 


1 


1 






90-94 


% 


3 




9 


2 


8 




2 




1 


85-89 




5 




6 




7 


3 


4 




7 


80-84 


% 


2 




7 


1 


7 


3 


7 




3 I 


75-79 








9 




6 


1 






1 


70-74 


% 


4 




4 




9 


3 


7 




8 


65-69 




7 


2 


3 




9 




2 




3 


60-64 


% 






4 
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3 


7 


1 


3 2 


55-59 
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8 
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3 




1 


50-54 


% 


5 
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1 
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1 


4 


45-49 








3 
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1 


4 
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40-44 


% 


6 


3 


2 


1 


2 


1 


6 


1 


7 j 1 


35-39 




4 


1 


5 




3 




2 


1 


5 


30-34 


% 


4 


3 


2 




5 


4 


4 




8 1 1 


25-29 




13 


5 


7 


2 


4 




8 




5 


20-24 


% 






1 




4 


2 


4 


2 


6 1 


15-19 




11 


3 


6 




7 


2 


4 




7 


10-14 


% 


5 


1 


2 


2 


2 


3 


8 


1 


4 


5- 9 




10 


9 


6 


7 


7 


8 


11 


4 


12 2 j 


0-4 


% 


14 


11 


3 


4 


4 


8 


9 


10 


10 11 


Median % 


26% 


17% 


59% 


9% 


62% 


24% 


39% 


5% 


1 32% 1 6% 



Summation of the Test scores for the Munroe Reading Aptitude Test as 

achieved by the children in the Bilingual Education Program. Total Anglos (A) 

childre=103; Total Spanish speaking or Spanish surname (S)=45. 24 of the Spanish 

children did not take the Auditory, Articulation, or Language tests. 
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Prince School Reading Readiness Program 1971 
Frequency of Scores - May 1971 




achieved by the childrenin the control group. Total Anglo (A) children = 28; 

total Spanish speaking or Spanish surname (S) - 7. 

Table 7 
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statistics in better perspective by presenting median score profiles of the 
Monroe Reading Aptitude Tests. Examination of this figure indicates that 
profiles of Anglo and Spanish students in the bilingual schools and the control 
school were similar in appearance. The most notable difference in perfor~ 
ance between bilingual and control groups was in the articulation subject area. 
In this area, the median percentilefor Anglo students in the bilingual classes 
was 39% compared with 70% for Anglo students in the control group. For 
Spanish students in the bilingual classes, the median percentile in articula- 
tion was 5%, contrasted with 25% for Spanish children in the control group. 

A close examination of English speech patterns of the kindergarten Bilingual 
Teacher will be made in order to determine whether or not she set poor 
examples for articulation. 

Language Facility 

With respect to the language subject area, testing for baseline data was 
conducted in eight bilingual classes (two classes in each of the reading readi- 
ness, first, second, and third grades). One second grade and one third grade 
control class was used in the pre-test phase. In post testing the same arrange 
ment prevailed except that only one second grade bilingual class was involved 
in post-testing. All language test scores were placed in a paired scores 
format and was subjected to t-tests for correlated variables. Table III indi- 
cates summaries of statistics for the reading readiness and first grades. 

Table IV presents similar statistics for grades two and three. Since no 
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LANGUAGE FACILITY - GRADE ONE 
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LANGUAGE FACILITY - GRADE TWO 
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LANGUAGE FACILITY - GRADE THREE 
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post-test control data were available for the language test in the reading 
readiness and first grades, the only comparisons made were pre versus post 
within bilingual classes* The computed t statistics indicate that there was no 
significant difference in pre-post scores in the reading readiness grade for 
either Spanish or Anglo groups. In the first grade, however, both Spanish 
and Anglo groups experienced a significant post-test improvement as compared 
with their pre-test scores. In grades two and threem pre versus post compari- 
sons within bilingual classes and bilingual versus control comparisons were 
made. For grade two, within bilingual classes, pre versus post test compar- 
isons for Spanish and Anglo groups were not significant. Comparison of 
bilingual versus control post-test scores, for both Spanish and Anglo groups, 
failed to reveal any significant difference. For grade three, however, the 
reverse situation exists. That is to say, within bilingual classes pre versus 
post comparisons of both Spanish and Anglo showed significant differences at 
the .05 level. Inaddition, comparison of bilingual and control post-test 
scores with Spanish children revealed significant differences, although this 
finding is mitigated because of significant differences in their pre-test 
scores as well. 

The John T. Dailey Test of Language Faciltites was used to gather data. 
Although the instrument finally worked, the scoring system is under question. 
Using the Dailey scoring system, progress is demonstrated by all of the 
bilingual classes. But, the progress is not of a significant nature. Dr. 
Sanford Cohen of Stanford University has devised a new scoring system for 
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MEAN RANK ORDER - BILINGUAL CLASSES - LANGUAGE FACILITY 
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Grade RR 
Pre Post 
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Table 


10 


Mean rank order data presented by group for only those children 
who participate'’ in both the pre-test and the post test for language 



facility* 



« 29 - 

33 



this test which we will use with next year's data analysis. Using it this year 
would only indicate that the evaluators “juggled" data. 

Word Knowlege, Reading, and Mathematics 

Testing in the word knowledge, reading, and ma thematic s subject areas 
was conducted in grades two and three. Table VI presents summary statistics 
of all comparisons made in the second grade. These include: 

1. Pre-test score comparisons of bilingual and control classes. 

2. Pre-test score comparisons of Title VII and non-Title VII classes 
in the same schools. 

3. Post-test score comparisons of bilingual and control classes. 

4. Post-test score comparisons of Title VII and non-Title VII classes 
in the same schools. 

The table shows t statistics based on comparisons of all children who partic- 
ipate in the pre-testing and all children who participate in the post-testing. 
Tables VI, VII, AND VIII provide the more detailed statistics which led to 
the computation of the t statistic for word knowledge, reading, and mathem- 
atics, respectively. 

For grade two the results of the statistics may be summarized in the 
following manner: 

1. In pre-test comparisons, there is no significant difference between 
the pre-test scores of Spanish in the bilingual program and Spanish 
children in the control school for word knowledgem reading, or 
mathematics. This indicates that the groups were similar to 
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begin with. 



2. There is a significant difference between the scores of Anglo 
children in the bilingual program and the control group in all 
three subjects. 

3. There is also a significant difference between the scores of Anglo 
children in the Ttile VII program and those in the same school but 
not in the Title VII program. This finding is true in word knowledge 
and reading. It is not true in mathematics. 

4. The difference between non-Title VII children and control group 
children is significant in pre-test scores of reading and mathematics. 
Word knowledge scores for this category are not significantly differ- 
ent. 

5. In pre to post-test score comparisons, significant differences abound. 
There are significant differences between bilingual and non-bilingual 
students in Title VII schools; between bilingual and control groups 
not in Title VII schools (both for Spanish and Anglo children); and this 
significance exists in word knowledge, reading;, and mathematics. 

6. There is no significant difference in post-test score comparisons 
between bilingual and control groups in word knowledge, reading, or 
mathematics for Spanish-speaking children. The statistically sig- 
nificant pre-test differences between scores of the Anglo bilingual 
program children and the control group children is repeated for word 
knowledge and reading in the post-test scores. In arithmetic, the 
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control group children ^'caught up*' to the bilingual program children. 
(Their scores are similar.) 

7. The Anglo children in the Title VII program had significantly higher 
scores than the children in the same school who were not in the 
Title VII program. However, the fact that their pre-test scores were 
also higher must be taken into consideration when evaluating these 
pst-test score differences. 

8. When viewing the statistics in terms of mean change for paired scores, 
the results indicate that the control group showed greater mean change 
for both Spanish and Anglo children than bilingual program. 

The program classes showed a positive and in many cases significant growth. 
However, in several cases, identified in the earlier paragraphs, the control 
classes did better. This was especially true in the third grade. The third grade 
program teachers, in the opinion of the evaluator, were among the best in the 
city. They established an unusually good team situation and did exceptionally 
well with their classes. However, the central class had even greater advantages 
w'hich evaluators did not discover until late in the school year. The control 
third grade teacher was Puerto Rican and used a great deal of Spanish. He also 
was blessed with an unusually small class (18) and an aide, and a reading spe- 
cialist who took his children to remediation. Next year's control will be more 
representative of the school system. 

Turning now to grade three, summary statistics are presented in Table 
IX similar to the ones presented for grade two in Table V. Pre-test ccmparisons 
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were made between bilingual and control classes, Title VII and non-Title VII 



control classes, and post-test comparisons between Title VII and non-Title 
VII classes in the same schools. More detailed statistics upon which these 
comparisons were made are presented in Tables X, XI, and XII for knowledge, 
reading, and mathematics, respectively. 

As a result of pre-test comparisons, it was found that no significant 
difference existed in the word knowledge scores of the Spanish children in the 
bilingual program and those in the control group. However, significant 
differences did exist for these groups when examining their reading and 
mathematics scores. 

The Anglo children in the bilingual program differed significantly in their 
pre-test scores from those of the Anglo children in the control group for all 
three subject areas. However, for the children in the non-Title VII program 
in the same schools as the Title VII program, no significant differences existed 
in pre-test scores in any of the subject areas which were examined. In pre- 
versus post- test score comparisons, all groups (that is, Spanish students in 
bilingual, non-Title' VII, control classes, and Anglo students in these same 
groups) experienced significant improvements in reading, word knowledge, 
and mathematics. In post-test score comparisons, there was no significant 
differences in the scores of Spanish children in the bilingual program versus 
Spanish children in the control classes. These post-test comparisons also 
failed to show significance when examining Anglo bilingual versus Anglo control 



classes in the same schools, post-test comparisons between bilingual and 
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students and this holds for word knowledge, reading, and mathematics. It 
may be noticed that the Spanish controlled children did perform exceedingly 
well, but these data are based on an extremely small smaple (N = 4) and are 
not statistically significant. Finally, it may be observed that as in the second 
grade, third grade Anglo children in the non-Title VII program of Horace Day 
and Truman Schools had significantly higher scores than the Anglo children 
in their bilingual program. 

Summary 

To opeiationalize the preceding pages of statistical *'gibberish'*; 

. Title VII children increased in all areas to a level which was higher 
than non-Title VII children. However, the differences at the end 
of the year were not significant. 

. Title VII children showed better improvement than did non-Title 
VII children in language facilities but not to a significant degree. 

. Spanish surname kindergarten children require more of the readiness 
lessons in Spanish, as noted by data presented. 

. All of the Title VII groups showed significantly better gains in self- 
concept than did the control groups. 
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WORD KNOWLEDGE - GRADE TWO 
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Oi£* grade equivalent of that score 
o standard deviation 
t t statistic 

Lst^sst large sample t test or small sample 
test t statistic 
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t Statistics - Grade Two - Word Knowledge, Reading, and Arithmatic 



Pre-test Scores to Pre-test Scores 



Subject 


Group 


Comparison 

(Title VII)Bilingual to Control(Prince) 






t 


Signifigance 


Word Knowledge 


Puerto Rican 


.479 


- 


Reading 


li 


1. 106 




Arithmatic 


ti 


. 254 


- 


Word Knowledge 


Anglo 


2. 641 


<, 05 


Reading 


II 


3. 876 


<. 05 


Arithmatic 


II 


2.389 


<. 05 


Pre-test Scores to Pre-test Scores 


Title VII to Non 


Comparison 

-VII in same schools 






t 


Signifigance 


Word Knowledge 


Anglo 


2. 098 


<. 05 


Reading 


II 


2. 105 


<. 05 


Arithmatic 


II 


. 163 


•• 


Post-test Scores 


to Post-test Scores 


Com par tson 

(Title ViDBilingual to Control (prince) 






t 


Signifigance 


Word Knowledge 


Puerto Rican 


.708 


- 


R eading 


II 


.074 


- 


Arithmatic 


It 


1.439 


— 


Word Knowledge 


Anglo 


1.776 


<. 05 


Reading 


II 


2. 559 


<. 05 


Arithmatic 


II 


1.342 


•• 


Post-test Scores 


to Post-test Scores 


Title VII to Non- 
t 


Comparison 
-VII in same schools 
Signifigance 


Word Knowledge 


Anglo 


1.92 


<. 05 


Reading 


II 


1.88 


< . 05 


Arithmatic 


II 


1.98 


<.05 



t statistics based on the comparisons of all the chiidrei. in tne 
pre-tests and all the children in the post tests in Grade Two. 

-^5 



Table 16 



t Statistics - Grade Three - Reading, Word Knowledge , and Arithmatic 



Pre-test Scores to Pre-test Scores 
Subject Group 

Word Knowledge Puerto Rican 

Reading “ 

Arithmatic “ 

Word Knowledge Anglo 

Reading " 

Arithmatic ’* 

Pre-test Scores to Pre-test Scores 

Word Knowledge Anglo 

Reading " 

Arithmatic " 

Post-test Scores to Post-test Scores 

Word Knowledge Puerto Rican 

Reading '* 

Arithmatic ” 

Word Knowledge Anglo 

Reading " 

Arithmatic " 

Post-test Scores to Post-test Scores 

Word Knowledge Anglo 

Reading “ 

Arithmatic " 



Comparison 

(Title VII ) Bilingual to Control (Prince) 

t Signifigance 

1.105 

1.670 .10 

1.948 <.05 

1.442 <.10 

1.996 <.05 

2.411 <.01 

Comparison 

Title VII to Non -VII in same schools 
t Signifigance 

. 068 
. 740 
.439 

Comparison 

(Title VII ) Bilingual to Control (Prince) 
t Signifigance 

. 554 
1.076 
1.310 

.781 

.748 

.812 

Comparison 

Title VII to Non -VII in same schools 
t Siguifigance 

3.059 <.01 

2.072 <.01 

1.863 <.05 



Table 17 



t Statistics based on the comparisons of the children in the pre 
tests and the children in the post tests in Grade Three. 
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V. ANALYSIS OF SELF-CONCEPT DATA 



T -tests done on the pre -scores of the children taking the self-concept 
tests show no significant differenwC between the Bi?'ngual Progran. children 
and the Control Group children in grade two. In grade three, however, there 
is a significant difference between the Anglo program children and the Anglo 
control children. This is to the level of . 025 (T=2. 281). The Spanish children 
have similar pre- scores in grade three. 

The post bilingual / post control scores show no significan*. differences in 
grades two or three for Spanish or Anglo except in grade three Anglo (T=l. 747). 

Grouped, grades two and three also show no significant difference in either 
group, Spanish or Anglo. 

Children in the Rea iing Readiness and first grade classes under Title VII 
did show a significant improvement in self-concept. On the other hand, control 
children did not show a significant improvement (P< . 05). 

Similar results were seen in third grade with program children showing 
significant gains (P^.05) and control showing very little. 

Second graders in program and control classes showed little or no change. 
This is attributed to the fact that one group of Puerto Rican children had a weak 
model and showed scores that reflected her weakness. (She is no longer with 






o 

ERIC 



the program). 



SELF CONCEPT RATING - GRADE RI; 
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Control 


Pre 


Post 
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Matched 
Pair ttst 


Pre 


Post 


Matched 
pair t tst 


Spanish 
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10 


15 


o 

•, 0 


4 






X= 


41.60 


31.67 


XD=-822! 

J 


31 


NO 




0= 


9. 43 


8. 36 


t = 1.99 


8. 64 






Anglo 


N= 


22 


21 


12 


7 


DATA 





X= 


35.55 


25.48 


XD=-975 


34. 43 




6= 


9. 76 


4. 99 


t = 117 
1 


8. 85 

'ii 




1 

l_ 



Note: a decrease in score indicates an. increase in self esteem. 



SELF CONCEPT RATING - GRADE ONE 
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Spanish 
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' - - ■ 
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.1 
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SELF CONCEPT BATING - GRADE TWO 









Bilingual 
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\ 
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\ ' ‘ 
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Control 






Pre 


Post 


Matched 
Pair ttst 


Pre 


I Post ! 




N= 


11 


14 
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8 


I 9 

t- 


Spanish 


X= 


32. 64 


30. 64 


XD=-4. 00 


37.38 


1 J 




5= 


8.94 


7.04 


t = • 66 


9.32 


i 

1 9.03 




N= 


13 


13 


12 


1 12 

J. . ^ , . 


13 


Anglo 


X= 


28. 00 


27.23 


XD= -1.3; 


1 

\ 

i 30. 00 


j 

' 30.77 j; 




6= 


9. 08 


! 5.72 
1 ■ - 


t = .763 j 


i 11.53 

* 


10.13 i 

* .I.4. 



. j 



XD=-7.O0 ! 



t= 1.75 



11 



t =.131 



Note: a decrease in score indicates an increase in self esteem. 



SELF CONCEPT RATING - GRADE THREE 
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33.26 
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L - ^ 


39. 00 

1 - -1 
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XD=1.50 i 


9.44 


7.81 


t =1.87 


j 9.88 


12. 60 


t = . 453 ■ 


Anglo 
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N= 

X= 

o^= 


32 


24 


22 


L_ 


8 i 


L. : i 
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36.63 1 31.96 


XD=-432 i 


i ! 1 , * 

129.25 i 27. 38 iXDi-L75 ; 
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8.12 ! 6.92 


t =285 !l 7.50 3. 46 ; t = .61 j 

i u ^ ^ i 
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MEAN RANK ORDER - BILINGUAL CLASSES - SELF CONCEPT 
Grade RR Grade One Grade Two Grade Three 



9 



Pre 


Pos-t 


Pre 


Post 


Pre 


Post 


Pre 


Post 


9 


9 


17 


17 


7 


7 


9 


9 


12,67 


14. 06 


16.97 


13.15 


12.14 


10. 57 


12.77 


12.55 


12 


12 


11 


11 


12 


12 


22 


22 


9.75 


8.71 


10. 68 


13. 32 


8.75 


9. 58 


17.32 


17.41 


21 


21 


28 


28 


19 


19 


31 


31 


11 


11 


14. 5 


14. 5 


10 


10 


16 


16 



MEAN RANK ORDER - CONTROL CLASS - SELF CONCEPT 



N= 

Spanish 

X= 



N= 

Anglo 

X= 



N= 

Class 

X= 



I 

I 

' N= 

Spanish 

X= 
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